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Abstract. In a number of papers, Y. Sternfeld investigated the problems of repre¬ 
sentation of continuous and bounded functions by linear superpositions. In particular, he 
proved that if such representation holds for continuous functions, then it holds for bounded 
functions. We consider the same problem without involving any topology and establish a 
rather practical necessary and sufficient condition for representability of an arbitrary func¬ 
tion by linear superpositions. In particular, we show that if some representation by linear 
superpositions holds for continuous functions, then it holds for all functions. This will lead 
us to the analogue of the well-known Kolmogorov superposition theorem for multivariate 
functions on the d-dimensional unit cube. 
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1. Introduction 


Let X be any set and hj : X —)■ M, i = 1, ...,r, be arbitrarily fixed functions. Consider 
the set 


B{X) = B{hi,...,K-,X) 


9i{hi{x)), X eX, 

i=l 



( 1 . 1 ) 


Members of this set will be called linear superpositions (see [35]). We are going to answer 
the question: what conditions on X guarantee that each function on X will be in the set 
B{X)7 The simplest case X C M'^, r = d and hi are the coordinate functions has been 
solved in [16]. See also [5,15] for the case r = 2. 

By Bc{X) and Bb{X) denote the right hand side of (1.1) with continuous and bounded 
Qi : R ^ R, i = 1, respectively. Our starting point is the well-known superposition 
theorem of Kolmogorov [17]. It states that for the unit cube I'^, I = [0,1], d > 2, there 
exists 2d+ 1 functions C C'(I'^) of the form 


d 

Sq{xi, ..., Xd) = ^ y^pq{xp), y:>pq G C(I), p = 1,..., d, q = l,...,2d+l (1.2) 

p=i 

^ This research has been supported by INTAS under Grant YSF-06-1000015-6283 
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such that each function / G C'(I‘^) admits the representation 

2d+l 

/(^) = X] 9q{Sq{x)), X={Xl, ...,Xd) e I"*, Qq G C'(M). (1.3) 

q=l 

In our notation, (1.3) means that i3c(si,..., S 2 d+i; I'^) = C(I^). This surprising and deep 
result, which solved (negatively) Hilbert’s 13-th problem, was improved and generalized 
in several directions. It was hrst observed by Lorentz [21] that the functions Qq can be 
replaced by a single continuous function g. Sprecher [29] showed that the theorem can be 
proven with constant multiples of a single function ip and translations. Specihcally, cppq in 
(1.2) can be chosen as X^ip{xp + eq), where £ and A are some positive constants. Fridman 
[9] succeeded in showing that the functions ippq can be constructed to belong to the class 
Lip{l). Vitushkin and Henkin [35] showed that ippq cannot be taken to be continuously 
differentiable. 

Ostrand [25] extended the Kolmogorov theorem to general compact metric spaces. In 
particular, he proved that for each compact d-dimensional metric space X there exist con¬ 
tinuous real functions C C{X) such that Bc{ai,a 2 d+i', X) = C{X). Sternfeld 

[32] showed that the number 2d -|- 1 cannot be reduced for any d-dimensional space X. 
Thus the number of terms in the Kolmogorov superposition theorem is the best possible. 

Some papers of Sternfeld have been devoted to the representation of continuous and 
bounded functions by linear superpositions. Let C{X) and B{X) denote the space of 
continuous and bounded functions on some set X respectively (in the hrst case, X is 
supposed to be a compact metric space). Let F = {h} he a family of functions on X. F is 
called a uniformly separating family [u.s.f.) if there exists a number 0 < A < 1 such that 
for each pair {xjj^^, {zj}Jhi of disjoint hnite sequences in X, there exists some h E F 
so that if from the two sequences {h{xj)}^iaiid {h{zj)}^^ in h{X) we remove a maximal 
number of pairs of points h{xjj and h{zj 2 ) with h{xj^) = h{zj^), there remains at least 
Am points in each sequence (or , equivalently, at most (1 — A)m pairs can be removed). 
Sternfeld [31] proved that for a hnite family F = {hi,..., hr} of functions on X, being a 
u.s.f. is equivalent to the equality Bb{hi,..., hr] X) = B{X), and that in the case where 
X is a compact metric space and the elements of F are continuous functions on X, the 
equality Bc{hi,..., hp, X) = C(X) implies that F is a u.s.f. Thus, in particular, Sternfeld 
obtained that the formula (1.3) is valid for all bounded functions, where gq are bounded 
functions depending on / (see also [15, p.21]). 

Let X be a compact metric space. The family F = (h) C C{X) is said to be a measure 
separating family [m.s.f.) if there exists a number 0 < A < 1 such that for any measure p 
in F(X)*, the inequality ||poh“^|| > A ||p|| holds for some h G F. Sternfeld [33] proved 
that Bc{hi, ..., hr]X) = F(X) if and only if the family (hi,..., hr} is a m.s.f. In [31], it has 
been shown that if r = 2, then the properties u.s.f. and m.s.f. are equivalent. Therefore, 
the equality Bb{hi, h 2 ] X) = B{X) is equivalent to Bc{hi, h 2 ] X) = F(X). But for r > 2, 
these two properties are no longer equivalent. That is, Bb{hi,..., hp, X) = B{X) does not 
always imply Bc{hi,..., hp, X) = C{X) (see [33]). 

Our purpose is to consider the above mentioned problem of representation by linear 
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superpositions without involving any topology (that of continuity or boundedness). More 
precisely, we want to characterize those sets X for which B{hi,hr] X) = T{X), where 
T{X) is the space of all functions on X. This will be done in terms of dosed paths, the 
explicit and practically convenient objects. We show that nonexistence of closed paths in 
X is equivalent to the equality B{X) = T{X). In particular, we will obtain that Bc{X) = 
C{X) implies B{X) = T{X). Therefore, the formula (1.3) is valid for all multivariate 
functions over the unite cube I'^, where Qq are univariate functions depending on /. We will 
also present an example due to Khavinson [15] showing that even in the case r = 2, the 
equality B{hi,h‘ 2 ',X) = T{X) does not imply Bc{hi,h 2 ,X) = C{X). At the end we will 
make some observations around the problems of representation and interpolation by ridge 
functions, which are widely used in multivariate approximation theory. 


2. Closed paths 


In the sequel, by 5 a we will denote the characteristic function of a set Ac. M. That is. 


^Aiy) 


1, if y e A 
0, if A. 


The following dehnition is based on the ideas set forth in the works [1] and [16]. 


Definition 2.1. Given a set X and funetions hj : X —)■ R, i = 1, ...,r. A set of points 
{xi,...,Xn\ C X is ealled to be a elosed path with respeet to the funetions hi,..., hr (or, 
eoneisely, a elosed path if there is no eonfusion), if there exists a veetor A = (Ai,..., A„) 
with the nonzero real eoordinates A*, i = I, ...,n, sueh that 


= 0, i = l,...,r. (2.1) 

j=i 


Let for i = 1,...,r, the set {hfxj), j = 1, ...,n} have ki different values. Then it is not 
difficult to see that Eq. (2.1) stands for a system of homogeneous linear equations 

in unknowns Ai,..., A„. If this system has any solution with the nonzero components, then 
the given set {xi, ...,Xn} is a closed path. In the last case, the system has also a solution 
m = {mi, ...,mn) with the nonzero integer components m*, i = 1, ...,n. Thus, in Dehnition 
2.1, the vector A = (Ai,...,A„) can be replaced by a vector m = (mi,...,m„) with m* G 
Z\{0}, 

For example, the set/ = {(0, 0, 0), (0,0,1), (0,1,0), (1,0,0), (1,1,1)} is a closed path 
in R^ with respect to the functions hfzi, Z 2 , z^) = Zi, i = 1, 2, 3. The vector A in Dehnition 
2.1 can be taken as (—2,1,1,1, —1). 

In the case r = 2, the picture of closed path becomes more clear. Let, for example, 
hi and /i 2 be the coordinate functions on R^. In this case, a closed path is the union of 
some sets with the property: each consists of vertices of a closed broken line with 
the sides parallel to the coordinate axis. These objects (sets A^) have been exploited in 
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practically all works devoted to the approximation of bivariate functions by univariate 
functions, although under the different names (see, for example, [15, chapter 2]). If X 
and the functions hi and /i 2 are arbitrary, the sets can be described as a trace of 
some point traveling alternatively in the level sets of hi and /i 2 , and then returning to its 
primary position. It should be remarked that in the case r > 2, closed paths do not admit 
such a simple geometric description. We refer the reader to Braess and Pinkus [1] for the 
description of closed paths when r = 3 and hj(x) = a*-x, x a* G i = 1, 2, 3. 

Let T{X) denote the set of all functions on X. With each pair (p. A), where p = 
{xi,..., Xn} is a closed path in X and A = (Ai,...,An) is a vector known from Dehnition 
2.1, we associate the functional 

n 

: T{X) ^ M, G'p,a(/) = 

In the following, such pairs (p. A) will be called closed path-vector pairs of X. It is clear 
that the functional Gp^\ is linear. Besides, Gp^\{g) = 0 for all functions g G B{hi, ..., X). 

Indeed, assume that (2.1) holds. Given i < r, \ei z = hi{xj) for some j. Hence, 
Ej {h,{xj)=z) E = 0 and Ej (hiixj)=z) >^j 9 i{hi{xj)) = 0. A summation yields Gp,x{giohi) = 0. 
Since Gp^x is linear, we obtain that Gp^x{Yll=i 9i ° ~ 0- 

The following lemma characterizes the set B{hi ,..., hr',X) under some restrictions and 
will be used in the proof of Theorem 2.5 below. 

Lemma 2.2. Let X have closed paths hi{X)r]hj{X) = 0, for all i,j G {1,..., r}, i ^ j. 
Then a function / : X —)■ M belongs to the set B{hi ,..., hr] X) if and only if Gp^xif) = 0 
for any closed path-vector pair (p. A) of X. 

Proof. The necessity is obvious, since the functional Gp^x annihilates all members of 
B{hi ,..., hr]X). Let us prove the sufficiency. Introduce the notation 

Yi = hi(X), i = 1, ...,r; 

n = Xiu...uw. 

Consider the following subsets of hi: 

C = {Y = {pi, ...,Pr} : if there exists x E X such that hi{x) = Pi, i = 1, (2.2) 

Note that £ is a set of some certain subsets of H. Each element of £ is a set Y = 
{pi, ..., Pr} C H with the property that there exists x E X such that hi{x) = yi, i = 1,..., r. 
In what follows, all the points x associated with Y by (2.2) will be called (*)-points of Y. It 
is clear that the number of such points depends on Y as well as on the functions hi,hr, 
and may be greater than 1. But note that if any two points xi and X 2 are (*)-points of Y, 
then necessarily the set {xi, X 2 } forms a closed path with the associated vector A = (1; —1). 
In this case, by the condition of the sufficiency, f{xi) = f{x 2 ). Let now Y* be the set of all 
(=t:)-points of Y. Since we have already known that f{Y*) is a single number, we can dehne 
the function 
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t:C^R, t{Y) = f{Y*). 

Or, equivalently, t(Y) = f{x), where x is an arbitrary (=t:)-point of Y. 

Consider now a class S of functions of the form where /c is a positive integer, 

Tj are real numbers and Dj are elements of £, j = We £x neither the numbers 

k, Tj, nor the sets Dj. Clearly, iS is a linear space. Over S, we define the functional 

/ k \ k 

-F 

\j = l / j = l 

First of all, we must show that this functional is well defined. That is, the equality 

ki k2 

i=i i=i 

always implies the equality 

j=i i=i 

In fact, this is equivalent to the implication 

k k 

TjSnj = 0 rjt{Dj) = 0, for all k E N, rj G M, Dj C C. (2.3) 

i=i i=i 

Suppose that the left-hand side of the implication (2.3) be satisfied. Each set Dj consists 
of r real numbers y {,..., yl, j = 1,..., k. By the hypothesis of the lemma, all these numbers 
are different. Therefore, 

r 

j = 1,...,/?. (2.4) 

i=l 

Eq. (2.4) together with the left-hand side of (2.3) gives 

(2.5) 

i=i j=i 

Since the sets {yl,yf, ...,|/f}, i = I, ...,r, are pairwise disjoint, we obtain from (2.5) that 

k 

'^rjSyi=0, i = ( 2 . 6 ) 

i=i 

Let now xi, ...,Xk be some (=t:)-points of the sets Di, ...,Dk respectively. Since by (2.2), 
yj = hi{xj), for i = l,...,r and j = l,...,k, it follows from (2.6) that the set {xi,..., 
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is a closed path. Then by the condition of the sufficiency, Yl^j=i — 0- Hence 

~ 0- have proved the implication (2.3) and hence the functional F is well 

defined. 

Note that the functional F is linear (this can be easily seen from its dehnition). Let F' 
be a linear extension of F to the following space larger than S: 


where k E N, rj G M, uj C ff. As in the above, we do not fix the parameters k, rj and Uj. 
Dehne the functions 

( 7 , g,{y,)=^ F'(5,J, * = l,...,r. 

Let X be an arbitrary point in X. Obviously, a; is a (=t:)-point of some set Y = {yi, ...,yr} C 
C. Thus, 


fix) 


i=l 


^ F(Sy) ^ F (Fs,) 

r r 

^giiVi) = ^9iihiix)). 

i=l i=l 




□ 

Definition 2.3. A closed path p = {xi,..., Xn} is said to be minimal if p does not 
contain any closed path as its proper subset. 

For example, the set I = {(0,0,0), (0,0,1), (0,1,0), (1,0,0), (1,1,1)} considered 
above is a minimal closed path with respect to the functions hi{zi, Z 2 , z^) = Zi, i = 1, 2, 3. 
Adding the point (0,1,1) to /, we will have a closed path, but not minimal. The vector A 
associated with / U {(0,1,1)} can be taken as (3, —1, —1, —2, 2, —1). 

A minimal closed path p = (xi, ...,Xn} has the following obvious properties: 

(a) The vector A associated with p by Eq. (2.1) is unique up to multiplication by a constant; 

(b) If in (2.1), Yfj=i l-^il = 1) then all the numbers \j, j = 1, ...,n, are rational. 

Thus, a minimal closed path p uniquely (up to a sign) dehnes the functional 

n n 

i=i i=i 

Lemma 2.4. The functional Gp^\ is a linear combination of functionals Gp^, ...,Gpi_,, 
where pi, ...,pk are minimal closed paths in p. 
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Proof. Let (p, A) be a closed path-vector pair of X, where p = {xi,and A = 
(Ai,...,A„). Assume that p is not minimal. Let pi = {yi, ...,ys} be a minimal closed 
path in p and 


S S 

GpiW) = 

i=i i=i 

To prove the lemma, it is enough to show that Gp^\ is a linear combination of and 
some functional Gi^p, where I is a closed path in X and a proper subset of p. Without loss 
of generality, we may assume that yi = xi. Put 

Vl 

Then the functional Gp^\ — tiGp^ has the form 


k 

Gp,\ — tiGp^ = Sjf {zj), 

where zj G p, 9j ^ 0, j = Clearly, the set I = { 2 : 1 ,..., 2 ;^} is a closed path with 

the associated vector 9 = ( 6 * 1 ,..., 9^). Thus, we obtain that Gi^g = Gp^\ — GGp^. Note that 
since Xi ^ /, the closed path I is a proper subset of p. □ 

Theorem 2.5. 1) Let X have closed paths. A function / : X —)■ M belongs to the space 
B{hi,..., hr] X) if and only if Gp{f) = 0 for any minimal closed path p <Z X with respect to 
the functions hi,..., hr. 

2) Let X has no closed paths. Then B{hi,..., hp, X) = T{X). 

Proof. 1) The necessity is clear. Let us prove the sufficiency. On the strength of Lemma 
2.4, it is enough to prove that if Gp^\{f) = 0 for any closed path-vector pair {p, A) of X, 
then / G B{X). 

Consider a system of intervals {{ai,hi) C such that {ai,bi) fl {aj,bj) = 0 for all 

the indices i,j G {1, ...,r}, i 7 ^ j. For i = 1, ■■■,r, let be one-to-one mappings of M onto 
{ai,bi). Introduce the following functions on X\ 

= ri{hi{x)), i = 1, ...,r. 

It is clear that any closed path with respect to the functions hi,..., hr is also a closed 
path with respect to the functions hi,..., hr, and vice versa. Besides, h'(X) fl h' (X) = 0 , 
for all i,j G {1, ...,r}, i 7 ^ j. Then by Lemma 2.2, 

f{x) = g[{h[{x)) -f ■ • ■ + g',.{h'^{x)), 

where g[,...,gl. are univariate functions depending on /. From the last equality we obtain 
that 
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fix) = 9'lixiihlix))) H- h g'riTrihrix))) = gi{hi{x)) H- h grihrix)). 

That is, / G 13{X). 

2) Let / : X —)■ R be an arbitrary function. First suppose that hi{X) fl hj{X) = 0, 
for all i,j G {1, i ^ j. In this case, the proof is similar to and even simpler than 

that of Lemma 2.2. Indeed, the set of all (*)-points of Y consists of a single point, since 
otherwise we would have a closed path with two points, which contradicts the hypothesis 
of the 2-nd part of our theorem. Further, the well definition of the functional F becomes 
obvious, since the left-hand side of (2.3) also contradicts the nonexistence of closed paths. 
Thus, as in the proof of Lemma 2.2, we can extend F to the space S' and then obtain the 
desired representation for the function / . Since / is arbitrary, T{X) = B{X). 

Using the techniques from the proof of the 1-st part of our theorem, one can easily 
generalize the above argument to the case when the functions hi,..., hr have arbitrary 
ranges. □ 

Theorem 2.6. B{hi,..., hr,X) = T(X) if and only if X has no closed paths. 

Proof. The sufficiency immediately follows from Theorem 2.5. To prove the necessity, 
assume that X has a closed path p = {xi, ...,Xn}. Let A = (Ai,..., A„) be a vector associated 
with p by Eq. (2.1). Consider a function /o on X with the property: foixi) = 1, for indices 
i such that A^ > 0 and foixi) = —1, for indices i such that A* < 0. For this function, 
Gp,xifo) 7^ 0. Then by Theorem 2.5, /o ^ B{X). Hence B{X) ^ T{X). The contradiction 
shows that X does not admit closed paths. □ 

The condition whether X have closed paths or not, depends both on X and the functions 
hi,...,hr. In the following sections, we see that if hi,..., hr are ’’nice” functions (smooth 
functions with the simple structure. For example, ridge functions) and X C R'’^ is a ’’rich” 
set (for example, the set with interior points), then X has always closed paths. Thus 
the representability by linear combinations of univariate functions with the hxed ’’nice” 
multivariate functions requires at least that X should not possess interior points. The 
picture is quite different when the functions hi,..., hr are not ’’nice”. Even in the case 
when they are continuous, we will see that many sets of R'’^ (the unite cube, any compact 
subset of that, or even the whole space R'’^ itself) may have no closed paths. If disregard 
the continuity, there exists even one function h such that every multivariate function is 
representable as g oh over any subset of R^. 


3. The analogue of the Kolmogorov superposition theorem for 

multivariate functions 

Let X be a set and h* : X —)■ R, f = 1, ...,r, be arbitrarily hxed functions. Consider 
a class A{X) of functions on X with the property: for any minimal closed path p <Z X 
with respect to the functions hi,..., hr (if it exists), there is a function /o in A{X) such 



that Gp{fo) 7 ^ 0. Such classes will be called ’’permissible” function classes. Clearly, C{X) 
and B{X) are both permissible function classes (in case of C{X), X is considered to be a 
normal topological space). 

Theorem 3.1. Let A{X) he a permissible function class. If B{hi,hr] X) = A{X), 
then B{hi,...,hr-,X) =T{X). 

The proof is simple and based on the material of the previous section. Assume for a 
moment that X admit a closed path p. The functional Gp annihilates all members of the 
set B{hi, ..., hr',X). By the above dehnition of permissible function classes, A{X) contains 
a function /q such that Gp(/o) 7 ^ 0. Therefore, /o ^ B{hi,hp, X). We see that the 
equality B{hi,hr] X) = A{X) is impossible if X has a closed path. Thus X has no 
closed paths. Then by Theorem 2.6, i3(hi,..., hr] X) = T{X). 

Remark. In the ”if part” of Theorem 3.1, instead of B{hi,hr] X) and A{X) one 
can take Bc{hi,hr] X) and G{X) (or Bb{hi,hr] X) and B{X)) respectively. 

The main advantage of Theorem 3.1 is that we need not check directly if the set X has 
no closed paths, which in many cases may turn out to be very tedious task. Using this 
theorem, we can extend free-of-charge the existing superposition theorems for classes B{X) 
or G{X) (or some other permissible function classes) to all functions dehned on X. For 
example, this theorem allows us to obtain the analogue of the Kolmogorov superposition 
theorem for all multivariate functions dehned on the unit cube. 

Corollary 3.2. Let d>2 and Sg, q = I, ...,2d+ 1, be the Kolmogorov functions (1.2). 
Then each function / : I'’* —)■ R can be represented by the formula (1.3), where Qg are 
univariate functions depending on f. 

It should be remarked that Sternfeld [31], in particular, obtained that the formula (1.3) 
is valid for functions / G B(I'^) provided that Pg are bounded functions depending on / 
(see [15, chapter 1] for more detailed information and interesting discussions). 

Let X be a compact metric space and hi G C(X), i = 1, ...,r. The result of Sternfeld 
(see Introduction) and Theorem 3.1 give us the implications 

Br{hi ,..., hr] X) = G{X) Bb{hi ,..., K] X) = B{X) => B{hu ..., K] X) = T{X). (3.1) 

The hrst implication is invertible when r = 2 (see [31]). We want to show that the 
second is not invertible even in the case r = 2. The following interesting example is due to 
Khavinson [15, p.67]. 

Let X C R^ consists of a broken line whose sides are parallel to the coordinate axis 
and whose vertices are 

(0; 0), (1; 0), (1; 1), (1 ; 1), (1 ; 1 -h ^), (1 -h ^ 1 -h ^),... 
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2 2 

We add to this line the limit point of the vertices (^,^). Let r = 2 and be 

the coordinate functions. Then the set X has no closed paths with respect to hi and 

/i 2 . By Theorem 2.6, every function / on X is of the form gi{xi) + ( 72 ( 2 ^ 2 ), {,xi,X 2 ) G X. 

Now construct a function /o on X as follows. On the link joining (0; 0) to (1; 0) /o(a:i, 0 : 2 ) 

continuously increases from 0 to 1 ; on the link from ( 1 ; 0 ) to ( 1 ; 1 ) it continuously decreases 

from 1 to 0 ; on the link from ( 1 ; 1 ) to (1 + 1 ) it increases from 0 to B on the link from 

(1 + ^; 1 ) to (1 + ^;! + ^) it decreases from ^ to 0 ; on the next link it increases from 0 

to etc. At the point (^, set the value of /o equal to 0. Obviously, /o is a continuous 

functions and by the above argument, /o(a:i,a; 2 ) = gi{xi) + ( 72 ( 3 ^ 2 )- But 771 and 772 cannot 

2 

be chosen as continuous functions, since they get unbounded as xi and X 2 tends to 
Thus, B{hi, h 2 ; X) = T{X), but at the same time Bc{hi, h 2 ] X) 7 ^ C{X) (or, equivalently, 
B,{hi,h2;X)j^B{X)). 

We have seen that the unit cube in has no closed paths with respect to some 2d + l 
continuous functions (namely, the Kolmogorov functions Sq (1.2)). From the result of 
Ostrand [25] (see Introduction) it follows that d-dimensional compact sets X also have no 
closed paths with respect to some 2d+l continuous functions on X. One may ask if there 
exists a hnite family of functions {h* : R'^ —)■ R})Li such that any subset of R'^ does not 
admit closed paths with respect to this family? The answer is positive. This follows from 
the result of Demko [7]: there exist 2d+l continuous functions ipi ,..., <p 2 d+i dehned on R'^ 
such that every bounded continuous function on R'^ is expressible in the form g 

for some g G C'(R). This theorem together with Theorem 2.6 yield that every function 
on R'^ is expressible in the form gi o for some 77 * : R —)■ R, i = 1, ...,2d + 1. 

We do not yet know if gi here or in Corollary 3.2 can be replaced by a single univariate 
function. We also don’t know if the number 2d + 1 can be reduced so that the whole 
space of R'^ (or any d-dimensional compact subset of that, or at least the unit cube I'^) 
has no closed paths with respect to some continuous functions (pi,..., (p*, : R'^ —)■ R, where 
k < 2d+ 1. One of the basic results of Sternfeld [32] says that the dimension of a compact 
metric space X equals d if and only if there exist functions (pi, ...,ip 2 d+i G C{X) such 
that i3c(v^i, •••, < 7 ’ 2 d+i; W) = C{X) and for any family {ipi}Yi C C{X), k < 2d + 1, we 
have Bci'ipi, X) 7 ^ C{X). In particular, from this result it follows that the number 

of terms in the Kolmogorov superposition theorem cannot be reduced. But since the 
equalities Bc{X) = C{X) and B{X) = T(X) are not equivalent, the above question on the 
nonexistence of closed paths in R'’* with respect to less than 2d+l continuous functions is 
far from trivial. 

If disregard the continuity, one can construct even one function 99 : R'^ —)■ R such that 
the whole space R^ will not possess closed paths with respect to p and therefore, every 
function / : R'^ —)■ R will admit the representation f = g o p with some univariate g 
depending on /. Our argument easily follows from Theorem 2.6 and the result of Sprecher 
[30]: for any natural number d, d > 2, there exist functions hp : I —)■ R, p = 1,..., d, such 
that every function / G 0(1'’*) can be represented in the form 
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^p\^pj I ? 


f(xi,...,Xd) =g i'^hp 

\p=l 

where 5 ^ is a univariate (generally discontinuous) function depending on / . 


4. Ridge functions 


The set B{hi,hr', X), where hi, i = l,...,r, are linear functionals over or more 
precisely, the set 


7^(X) = (a\...,a’’;X) 


(a*-x) 


; X G X C M"*, : M -)■ R, 



(4.1) 


appears in many works (see, for example, [1,2,8,12,14,19,20,27]). Here, a*, i = l,...,r, are 
hxed vectors (directions) in R‘^\{0} and a* ■ x stands for the usual inner product of a* 
and X. The functions Qi (a® ■ x) involved in (4.1) are ridge functions. Such functions are 
used in the theory of PDE (where they are called plane waves, see, e.g., [13]), in statistics 
(see, e.g., [3,11]), in computerized tomography (see, e.g., [14,20]), in neural networks (see, 
e.g., [28] and a great deal of references therein). In modern approximation theory, ridge 
functions are widely used to approximate complicated multivariate functions (see, e.g., 
[4,6,10,18,19,22,23,24,26,27,34,36]). In this section, we are going to make some remarks on 
the representation of multivariate functions by sums of ridge functions. 

The problem of representation of multivariate functions by functions in 77 (a^,..., a®"; X) 
is not new. Braess and Pinkus [1] considered the partial case of this problem: characterize 
a set of points (x\...,x^) C R'^ such that for any data {ai,...,ak} C R there exists a 
function g G 77 (a^,..., a®"; R®^) satisfying 5'(x®) = oti, i = In connection with this 

problem, they introduced the notion of the X/-property (non interpolation property) and 
MX/-property (minimal non interpolation property) of a hnite set of points as follows: 

Given directions C R'^\{0}, we say that a set of points {x®}f^^ C R®^ has the 

X/-property with respect to {a-^ }^^^, if there exists C R such that we cannot hnd 

a function g G 77 (a\..., a®"; R®^) satisfying gipid) = ai, i = We say that the set 

R®* has the MX/-property with respect to if {x®}^^^ but no proper 

subset thereof has the X/-property. 

It follows from Theorem 2.6 that a set {x®}f^^ has the X/-property if and only if {x®}f^^ 
contains a closed path with respect to the functions h* = a® ■ x, i = 1,..., r (or, simply, to 
the directions a®, i = l,...,r) and the MX/-property if and only if the set {x*}^^^ itself 
is a minimal closed path with respect to the given directions. Taking into account this 
argument and Dehnitions 2.1 and 2.3, we obtain that the set {x®}^^^ has the X/-property 
if and only if there is a vector m = (mi, ...,mk) G Z^\{0} such that 
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k 

-x^) = 0, 
i=i 

for i = 1, ...,r and all functions : M ^ R. This set has the MNI-property if and only if 
the vector m has the additional properties: it is unique up to multiplication by a constant 
and all its components are different from zero. This special corollary of Theorem 2.6 was 
proved in [1]. 

Since ridge functions are nice functions of simple structure, representation of every 
multivariate function by linear combinations of such functions may not be possible over 
many sets in R'^. The following remark indicates the class of sets having interior points. 

Remark. Let X C R'^ have nonempty interior. Then TZ (a^,..., a'"; X) ^ T{X). 

Indeed, let y be a point in the interior of X. Consider vectors b*, i = l,...,r, with 
sufficiently small coordinates such that a* • b* = 0, i = 1, ...,r. Note that the vectors b*, 
i = 1, ...,r, can be chosen pairwise linearly independent. With each vector e = (si, ...,er), 
Si G {0,1}, i = 1, ...,r, we associate the point 

r 

X£ = y+^£ibh 
i=l 

Since the coordinates of b* are sufficiently small, we may assume that all the points 
Xg are in the interior of X. We correspond each point x^ to the number (—1)1^1, where 
|e| = Si + • • • + Er- One may easily verify that the pair ({xg}, {(—1)'^'}) is a closed path- 
vector pair of X. Therefore, by Theorem 2.6, 7^ (a\ ..., a^; X) 7 ^ T{X). 

It should be noted that the above method of construction of the set {xg} is due to Lin 
and Pinkus [19]. 

Let us now give some examples of sets over which the representation by linear combi¬ 
nations of ridge functions is possible. 

(1) Let r = 2 and X be the union of two parallel lines not perpendicular to the given 

directions a^ and a^. Then X has no closed paths with respect to {a^, a^}. Therefore, 
by Theorem 2.6, TZ (a^,a^; X) = T(X). 

(2) Let r = 2, a^ = (1,1), a^ = (1,-1) and X be the graph of the function y = 

arcsin(sina;). Then X has no closed paths and hence TZ (a^,a^;X) = T{X). 

(3) Let now given r directions and r -|- 1 points C R*^ such that 

a^ ■ X* = a^ ■ x-^ Y ■ x^, for 1 < b J < ■'" + 1 , hj 7 ^ 2 
a^ ■ X* = a^ ■ x-^ Y ■ x^, for 1 < b J < + 1, L J 7 ^ 3 


a^ ■ X* = a'’ ■ x’ Y ■ x’’^\ for 1 < i, j < r. 
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The simplest data realizing these equations are the basis directions in and the 
points (0,0,...,0), (1,0, (0,1,...,0) (0,0,...,1). From the first equation 

we obtain that cannot be a point of any closed path in X = {x^,..., 
Sequentially, from the second, third, ..., r-th equations it follows that the points 
x^,x^, ...,x'’’''^ also cannot be points of closed paths in X respectively. Thus the set 
X does not contain closed paths at all. By Theorem 2.6, 7^(a^, ...,a’’;X) = T{X). 

(4) Let given directions and a curve 7 in such that for any c G M, 7 has at 

most one common point with at least one of the hyperplanes aX x = c, j = 1 , ...,r. 
By Definition 2.1, the curve 7 has no closed paths and hence TZ (a^,..., a*"; 7 ) = T{'j). 

At the end we want to draw the reader’s attention to one more problem concerning the 
set TZ (a^,..., a^; X). The problem is to determine if a given function / : X —)■ M belongs 
to this set. One solution is proposed by Theorem 2.5: consider all minimal closed paths 
p of X and check if Gp{f) = 0. This problem was considered by some other authors too. 
For example, Lin and Pinkus [19] characterized the set TZc (a^, ...,a'’;M'^) in terms of the 
ideal of polynomials vanishing at all points Aa* G M'’*, i = l,...,r, A G M. Two more 
characterizations of TZc (a^, ...,a^;M'^) may be found in Diaconis and Shahshahani [ 8 ]. 
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